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ABSTRACT 

To evaluate the perfortiince of eletectary school 
children on various paradigas for assessing, vocabulary knowledge 
on-line, three studies were conducted. In the first, 173' second 
through eighth grade students were involved .in an investigation of 
five approaches to vocabulary assessaectt syncnya in context, synonya 
out of context, cloze, oral recognition, and self-screeni^ig. Results 
revealed significant probleas with the self-screening and oral 
'"recognition foraats; they were therefcie eliainated froa the 
succeeding studies, A total of 184 first' thrcugt fifth graders' 
participated in the se,cond and third studies, which further evaluated 
the three reaaiiing formats. These studies also correlatec the 
children's perffirnance on the -.three paradiga^ with scores on a 
standiti;dized aeasute qt reading coaprehensicc. Ihe results suggest 
t:hat^^;p single format is superior in assessing vccatulary knowledge" 
acrosife all' grade lHvels. Data frba the third' study also indicate 
lower correlations between vocabulary knowledge and coaprehensicn 
ability for the second and third grades than for the fourth and fifth 
qrad^^, (i^uthor/Fl) " - \ 
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MISSION STATEMENT 



The mission of the Wisconsin Research and Development Center 
is to improve the quality of education by addressing the full 
range of issues and problems related to individualized schooling. 
Teaching,? learning r and the problems of individualization are 
given cojifc^rrent attention in the Center's efforts to discover ~ 
processes, and develop strategies and materials for use in the 
schools- The Center pursues i^s mission by ^ - 

• conducting and synthesizing research to clarify the 
processes of school-age children's learning and - ' 
development ' ' ■ 

• conducting vand synthesizing research ^ clarify effective 
approaches to teaching students basic skills and concepts 

• developing and demonstrating improved^nstructional strategies^ 
processes, and materials for student^ teachers, and school 
administrators ^ * " ' 

• providing assistance to educators which helps transfer the 
outcomes of research and development to improved practice 
in local schools and teacher education institutions 

The Wisconsin Research and DeveiopmenJ^3gj|pnter is supported 
with funds from the National Institute* of Education and the 
University of Wisconsin- * . * 
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On-Line Diagnosis of- Reading Dlf f Icultles-IV 



This is the final report in a series of four o^thp feasi- 
bility of using the PLATO system for on-line diagnosis, ol reading 
skills. Iiythe first study (Venezky, Bernard, Chicone, & Leslie, 
1975), a comparison was made between on-line and paper-and- 
pencil administra'tion of a comprehension test for fifth and sixth ^ 
graders. This study demonstrated that equivalent scores could be 
obtained and that pLaTO was usable at these grade levels for coxa- 
prehension testing, 

A second study (Venezky, Chicone, & Perry, 1976) explored 
the feasibility of on-line testing of letter-soUtid encoding with 
first, second, and third graders. The results of these studies 
were mixed. While five of the nine patterns tested^ showed results ' 
similar to thbge obtained by standard testing procedures, limita- 

V 

tions \fere found in the quality of the PLATO audio recordings and 
in the testing paradigm which was selected, . 

The third study (Venezky* Perry, Chicone, St Pittelman, 1977) 
examined three on-line techniques for assessing vocabulary knowledge 
self-screening, word matching under brief exposure, and synonyms. 
At the same time, the study provided s6me preliminary information 
on response-contingent testing. Brief descriptions of all 'tests 
developed, as well as an on-l^.ne bibliography of reading research 
literature, were^given in the Appendices o'f the report^documenting 



that s^tudy. 

This final set of feasibility studies is a continuation and 
refinement of the work begun in the third study ► This current 
study compart the performance of elementary school children of 
various reading' abilities on five different paradigms for assess- 
ing vocabulary knowledge: synonym in context, synonym out-of- 
context, cloze, oral recognition, and self-screening, . All develop- 
ment work was done at the Wisconsin Research and Development 
Center on a PLATO terminal which*^ncluded a touch detection collar 
and a printer. Testing for the first two studie)5 discussed in 
this paper was conducted at J^right Community College in Chi6*^o, 
Illinois. Testing for the thir^ study wk^ conducted at Columbia 
Elementary School In Champaign, Illinois. ^ 

k 

^^TUDY 1 

Study 1 examined the characteristics of five dif f etent^pproach 
to vocabulary testing: sel|-screening, oral recognition, jsynonym 
out-of-context, synonym in context, and cloze.' ^All formats, with 

the ex£eption of oral recognition, were administered on-line using 

X 

the PLATO terminal. Two formats, self-screening' and synonym out- 
of-context, had been tested in an earlier study (Venezky et al., 
1977), but many of the stimulus words and distractors used were 
revised. 

The Self-screening Test required subjects simply to indicate 



whether or ftot'they knew the* meaning of< a iarget wS^V^'^The Oral ^ 

Recognition Test, a •^)ap^r-and-pencil t^st^ required .sub jeqts' to 

find the exact matchvto a^ spoken word* from ainong four alternatives. 

The Synonym out-of-contq;xt Test required isubjects to choose; ..f rom . ^ 

■• ' . , ■ ^ ■ . ^-^ ^ . C ^ ' / • 

among four alternatives, ±he word closest, in meaning to a t&rget ^ 

word. The Synonym in C^litejct Te^fc presented the target word within 

the context of a sentence, and then required subg^cts to choose, from^ 

'^ajnong four alternatives, the word clpsest in meaning to the target 

word. The Gloze Tes? required subjects to select, from among four ^ 

alternatives, the word which best fit in a sentence iihat had one word 

deleted. V r ^ 

Method ' - ^ . ' ^ 

Each of the five test formats had. seven leveiSe of ^f faculty 
with^±en Items per level. (In the previous^ st:u*dy" [Venezky et al., C 
1977]. the Self-screeninj^Teist had six di£f$rent%levels with eight 



items per level.) The same stimulus words .were *Os6d on all fiv^ 
test formats, so that a direct compJarison of^est^ paradigms could 
be made. Words were selected from seve^ral standardized vocabulary 
tests' at each level to represent typical readitig voc^ularies from 
grades one through seven. Each test level represented a single 
grade level of^fficulty. The stimuli for Level 4 of the five 
test paradigms are shown in, Appendix A." 



A total of 173 elementary school y^udents in grades 2 through 

• " ,-..■.'■'''> ^ 

8 of an inner city Chicago elementary school participated in the 
Study ♦ ^/Testing was done in two separate sessiorf^- During the first 



13 ■) 



Session, ^ which took place in Dec^mb^r 1976,' 107 clSldren wer^ 

A * * ■ - » , 

l^^ed. The remaining 66 children were tested during the second* 

ses|5iDn, in January 1977. Each testing session lasted for two 

days • 

Procedure 



The subjects were brought from their classrooms in groups or,- 
,,24 to the testing site^^aVwrightv Junior Community Cor^^ege.^ The 
college was located approximately three blocks from the school. 
-Each testing period began with a short orientation, in which the 
si^jebts were assigned, a "PLATO name" (their own first name and 
any initial letters of their last name required to resolve same 
first, name conflicts). Subjects were then shown two dispfays in 
order to familiarize the^n with the, equipment and with the proce- 
dures for taking the tests. During these practice 'displays, sub- 
jects were instructed as to how to select and change 4n answer 

■ ■■■•■■,:':;f;:v^^--.., ^ , ' . ' \ \ 

The sign-on procedures took approximately three to five minuses, 

.' ^ 

with the longer times taken by younger subjects. Individual help»\ 
' ' ' f' 

with signing-on was given to all second and third grade subjects, 

because these younger pupils had difficulty locating specific 
letter keys on the standard typewri^t^r keyboard. Older subjects 
were given help only if they requested it. The practice displays ^ 
toolr f rom three to five minutes to complete, with younger subjects 
requiring the longer times. • 

Each subj^t w^s given the Self-screening Test, the Oral Recog- 
nition Test, and either the^Synonym out-of~context Test, the Synon3nfl 



In Context -T^^t, or/thc, Cloze Test. During the first testing 
session (December 1976), subjects t>egan the test session with 
the Self^screening^ Test, followed -by either the Synonym out-of- 
context Test, ' the Synonym/in Contexts Test , or the Cloze Test. 



Subjects,were thei^ taken from the PLATO terminals to tables for 

'I 

the paper-and-pencil Oral Recognition Test. . ' 

During the December testing, examiners observed th^t a large 
number of subjects responded correctly to items on the Oral 
Recognition Test before^the stimulug\<ord was spoken. (Subjects 
apparently circled words which they remembered seeing moments 
before on tlie two PLATO tests.) This effect was especially appar- 
ent • among older subjects. As a result, the order of administra- 
tion of the tests was changed before the second testing session 
(January 1977). In the January testing session, subjects/were 
first given the Self-screening Test, followed by the Oral Recogni- 
tion Test, and then either^ the Synonym out-of-context Test, the 
Synonym in Context Test, or the Cloze Test.' The change in test 
order required a small programming adjustment which locked subjects 

what . h£i^h)een a "resting'/ page. Subjects were then directed to 
tables where the Oral Recognition Test was administered. After 
completion of the Oral Recognition Test, subjects returned to their 
, terminals and were told which keys to press in order to view the 
last test. ' " 

Self-screening Test . Figure 1 illustrates the layout of a 
PLATO page ftom the Self-screening Test. This test was the first 



one administered. The subject was presented with five words at 
a time and was to touch those words whose meaning he/or she did 
not know. When a word was touched, a box appeared around It. 



Touch the words whose meaning you DON'T ^Tknow, 

■ ■ / ' ■ / 7 



A: 



hesitate 



menacing i 



confident 



gigantic 



If you know the meaning of 



brlsklyl 



aXl the words, press IIEXT 



Fx^ufe 1. The layout of a ^LATO page from the 
Self-screening Test. i 




A second touch Removed a box mistakenly placed around a word. ' 
After each set ofv five words had been. Inspected and the appropriate 
words touched, the^Siibject pressed the NEXT key on the keyboard 
to see vthe next set of words. After' the Self-screening Test was 
completed, the subjec^was shown a short diversionary display and 
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invited to rest foij|^a fev seconds. In the January testling, 
subjects were then directed to tables for the Oral Reccgnitldn 
Test. . -o . 

Oral Reco£ QltiOn._Test^. The Oral Recognition Test was a 
paper-and-pencii test. The test administrator pronounced a 
target word and subjects were to circle that word from a set of 
four response W^icds, The four resppnse .words for each Item were 
arranged in a horizontal row to the rights of the number for that 
item (see Figuf^ 2 on following page). After the Oral Recognition 
Test, subjects ^eturn^d to the terminals and p^ressed the NEXT key, 
which led. them to o^e of th^ three tests described below. ' 

Synonym ou CJiofrcg^text^T^t . Subjects were shown a word in 
a box near the top of the screen and faur response wdrds below 
it (see Figure 3) , ^ 



Tou^:!^ the word which is closest in meaning 
to the word in the box 



briskly 



awkv^a^rdlv 



sadly 



rapidly 



slowly 



If Vou are finished, press NEXT 
OR, ch^ng^ your answer touch another word. 



PigVite 3, The layout of a PLATO page from 
the Synonym out-of-context Test. 



rade 



Oral Recognition Test--^ 



1. 


briskly 


biscuit 


black ie 


briefly 


2. 


frfeedom 


triple 


feeble 


table 


3. 


st^ate 


estate 


hasty 


hesitate 






. gentle 


•gigantic 


gyration 


gymnast ic 


/ 




conceal^ed 


concrete 


concubine 


convinced 






r^bwder 


paucity . 


paper 


pauper 






convince 


confident 


condemn' - 


8. 

< 


'■' i-. . 
me^;feon 


jnenacing 


marking 


miendacity - 


9. 


obvious 


» abound 


obtain 


abstain 


10. ^ 


purpose 


persist 


purse 


pursued 



Figure 2 . An example of a page from* the paper-and-pencil 
administered Oral Recognition -Test. 
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the^subject was to" touch the wo«-d which was closest in meaning 
to. the word in the box. When a response word was touched, a 
box appeared around it. If^^the subject wanted to change the 
answer, he or she could do. so by touching another , response word. 
The erroneous box would erase and the %ewly selectg'd word would 
receive a box. 

Synonym in Context Test . Subjects were shown a sentence in 
which one of the words was underlined, as in Figure 4. Below 
the sentence were four response words. The sirtrg^t was to touch 
the word which was closest in meaning to the under line3^1^o?d. in 
the sentence. I 



Touch the word which is closest in m ^ing to 
the underlined word. 

The feeble old dog walked beside the woman. 

funny weak strong fleet 

If you are finished, press NEXT. 
OR, to change your answer touch another word. 

Figure 4. The layout of a PLATO page from 
the Synonym in Context Test. 
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1 



When a wprd waB touched, a box appeared around it. If the subject 
wanted to change the answer, he or she could do so by touching 
• anothe'^r response Word. ' The erroneous box would erase and the newly. 

1 , - • ^ 

selected word would received a bdx. 

Cloze Test . Subjects were shown a sentence in which there was a 
blank space in place of one of the words (see Figure 5) . 



Touch the word which best completes the sentence 



The horse trotted 



along a familiar path. 



af t*^^ 



below 



twelv^^ 



bris 



If you are , finished, press NEXT. 
OR, to change your answer touch ano ther word . 



Figure 5. The layout of a PLATO p^^ge from the 
/ Cloze Test. 

. ^ . ^ 

Below the sentence, were four response words, ^ne of which would 
make the sentence complete. The subject had to touch the response 
word which would best complete the sentence. When a word was touched, 
a box appeared around it. If ^ the subject wanted to change the answer, 
he or she could do so by touching another response word. The 
erroneous box wouJ^ erase and the newly selected word wOuld receive 
a box. ' * . ■ 
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Each subject took three levels of difficulty for each^test, ^ 
paradigm assigned: a test one gMde below grade level, a test at 
grade level, and a test one grade above grade level.- The' three 
levels were presented in order from below grade level, to at grade 
level, to above grade level. (Sixth, seventh, and eighth grade sub- 
jects received levels five, six, and ^even, because level syeven was 
the highest level that had been develdped.) Total completion time 
for all three levels of the three formats was between 20 and 30 
minutes. Average tiesting times were . early the salbie for. both testing 
sessions, even th tough subjects in the January session were required 
to move away from and then back to the PLATO terminals. 

Results 

Table 1 presents mean percentage correct scores listed by test 
format and by t^&t level. 

' ' . 

Table 1 ' • 





Mean 


Scores (% Correct) by Teet 


Level 


and Format 






Synonym 










'Self- 


out-of- 






. Oral 


Level 


screening 


context 


.Cloze Synonym 


in context recognition 


1 


95 


' ^5 


87 


29 


•cf ' ' 95 


2 


73 


'■J 

55 ' 


69 


55 


92' 


3 . 


60 


47 


50 


51 


^ 92 


4 


43 


42 


58 - ■ 


56 


95 


5 


63 


68 ^ 


79 


75 


97 


6 


72 


51 


88 


80 


, 100 


7 


■ 71 


■ ■ 67 


88 


86 


.100 
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The xe^\xX^^ of the self-screening format, arranged by test^evel 
and gr^de, shown in Table 2. Figure 6^hows these sam^re^ii^s 

in mean ^c^xe^ £ot each grade collapsed across test le>^ls. 

The tno^t Rotable aspect of these resulfB Is the higher scores 
of the Pri^^y (first, second, and third) and upper (seventh and 
eighth) gf^d^^ as compared to the middle grades (fourth, fifth, and 
sixth), higher scores of children ZlrT the primary grades may be 

due to thf^e . ^^ctors: (a) During testing, it was observed that many 
of the yoU^g^^ subjects did not always use the PLATO keyboard, 
appropriately* As a result, some subjects hit the "NEXT" key twice 

in succ^s^ofi' Thi^ caused a display of five words t^^l^e recorded 

*j ' . 

as vord^ tJ^aC Vcre known by subjects,, even though the five words had 
appeared o^l/ briefly on the visual display., (b) Younger subjects 
may haV^ b^ef^ oVetconfjUient of their knowledge of the word defini- 
tions, THis is indicated gjjj.y their relatively lower sQores on the 
other t^st fc?^^t8. (c) Word items for these lower gtade levels . 
were relatively niore common than words appea^'kng in the middle test 
levels* 

The hiShe^ scores of pupils in the upper grades (js even th and 

eighth) c^^ partially accounted for by the testing design. 

■J 

SeyeatH ai^^ eighth gtade subjects took the same three levels of the 
test a0 di^ ^ixth graders., . 

Soifl^ 0^ the confounding factors discussed above could be elimin- 
ated by aJ-^e^itig the PLATO program to prevent false positive marking 
ot voc^bxija^y Vords and by' changing and extending the word list. It 
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. ■ . ^ ' ' • labile 2 " • 
Mean Scores (%Cotrect), Standard Deviation, and Number of 
Sub'jects on Self-screening Format by Test Level ancf Grade . 



4- 



Test- 

level 2 ' 3 '4 



Grade 



1_ 

X , 95 • 

SD : 13 

N ' 22 

1 ■ •■ 

2_ 

X 68 , 77 

SD 24 21 

N ., . 22 22- 



23 ' J 



X 


54 "60 ' 


69 








SD 


30 29 


24 








N 


22 22 


23' 




















4 












X 


■ '45 


39 


49 






SD • 


27 


■ 24 


22 






N 


22 


23 


13 ■ 






5 












X V 




47 


58 


53 


69 


SD 




22 


22 


17 


17 


N 




23 


13 


25 


34 




t 


* 








6 












X 






74 


61 


74 


SD 






17 


14 


14 


N 






12 


25 


34 


7 












X 








62 


72 


SD 








14 


15 


N 








25 


34 


















f 




# 




• 




» \ 







80 
11 
34 



79 
11 
34 



77 
13 
34 





93 r 




80 - 




70 * 


y- 




EC 


60 - 




50 - 




o 




o 


40 - 






30 - 




20 - 




^ 



Figure 6. Mean scores (% correct) on 

~ gelf-screening format, by grade. 
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was decided, however, that the "overconf idence" If feet would, still 
^\be preeent, and would cause difficulty' in the interpi!^ation of 
-results. For this reason, further use gff the self-s§lection 

format was not planned." i 

" Oral Recognition I 

,s , ' • ^ ■ ■ ) ' 

The mean percentages correct on th$ oral recognitapn format 

are "listed in Table 3. It is apparent from the data in Tables 1 

and 3 that there is a pronounced ceiling effect for the Oral Re- 

cognition Test. This suggests that the test was too easy for the 

grades tested- ' ' ' 

Since the target words were the same as that on the other test 
formats, the task wd's apparently not measuring the vocabulary skiM 
which were of interest to the study. For this reason, no further 
consideration was given to the oral recognition format. ^ 
Synonym out-of -context 

Table 4 lists the mean scores for the synonym out-of ^context 
format shown by test level ^and by grade. Figure 7 plots the mean 
sdores for ^ach grade. J?he graph shows a linear increase with a 

noticeable dip in the fourth grade average. Table 4 indicates^ that 

J 

level four test scores were extremely low. Item analysis for^his 
test revealed that of the 10 items at that level, as many as seven 
\ ' (70%) coufd )have been two difficult for the grades tested. When a 



new reference source later became available, ±t w^s discovered that 
four of the 10 target words i^ level four wei^e considered to be 
seventh to ninth grade words (Dale & 0'TI:ourke,V976) . Two other 
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Table 3 " 
Mean l^cores (% Correct) on 
Oral Recoghltlon Format by Gradq, and Test Level 



Grade 



Test 
Level 


2 


3 




4 


, 5 


6 


7 


8 
















«. — ' 




1 












- 


• 




X 


95 


















10 f 
















N 
n 


22/ 


1 
















V 


1 














X 


87 


97 




• 














o 
















22 


22 














3 


















X 


89 


95 




93 








/ 




















M 
n 












» 






4 


















If 




95 




94 


100 








SD 




12 




15 


0 








N 




22 




23 










5 


















X 








90 


94 ' 


^' 93 


99 


99 


SD 








15 


10 


4 


4 


3 


N 


7 ' 






, 23 


13 


25 


34 


" 34. 


6 


















X 










100 


100 


99 


100 


SD 










0 


0 


2 


2 


N 










12 


25 


' > 34 


34 


7_ 


















X 












100 


100 


100 


SD 












0 


0 


2 


N 












25 


34 


34 
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: Table 4 , * » 

Me^n Scores (% Correct) on Synon3an out-of-context 
Format by Grade and Test Level ^ 



' Test 
level 



Gr^e - ' 



8k- 



.X 

SD 

N 



X 

SD 

N 



45 
30 
8 




3_ 
X- , 
SD 
N 



36 
23 
8 



47 
30 
7 



59 

11. 
7 



X 
SD 
' N 

5_ 
X 
SD 

N . 

6_ 
X 

SD. 
.N- 



,7 



X 
SD 



37- 
■> 31 
' 7 



29 

11 
7 

r 



31 
15 
7 



73 
22 
4 



-53 
29 
4 

45 
10 
4, 



• 68 
15 
* 6 



53 
18 

.6 



63 
14 
6 



73 
22 
12 



55. 
21 
12 



65 
21 

,12 



88 

13 ' 
12,' 



67 
17 
12 



72" 
14 
12 



1: 
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• 


oU 




70 - 


■ 

b 




UJ 


60 - 




50 - 


cc 






o 


40 - 








30 - 




20 : 
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GRADE LEVEL 



Figure ?/ Mean scores (% correct) on synonym 
. out-of-con^ext format, by gr;ade. 
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target words were listed as fifth to seventh grade words. This factor 

• / V • ' ' ■ . 

alone could acabunt for the relatively low performance by subjects 

• •* * ■ 

on level four. This experience , also highlights the inadvisability of 
♦ • 

using standardiz.ed vocabulary tests as sources of grade-appropriate 
vocabulary items. Item 8 from Level 4 of the Synonym out-of-context 
Test (shown below) illustrates the difficulty described above. The 
figure in parenthesis is the p^^entage of the national sample of 
students (at the grade level indicated) reported as knowing the words 
(Dale & O'Rourke, 1976). 



Target word: 
Distractors: 



L^t 




menacing 

'dangerou^ 
'inspiring", 
'regular" 
'slinking" 



(70% at eighth grade) 

(89% at fourth grade) 

(85% at eighth grade> 

(74% at fourth grade) 

(72% at eighth grade) 



Item analysis of Item 8 showed that 40% of the subjects chose the 
correct response ("dangerous") while the remaining 60% were evenly 
spread among the three other distractors. With this item as with 
at least six additional items in Level 4, the response patterns appeared 
to be random. . 

The overall rise in scores shown on the graph in Figure 7 may be 
partially expj.ained by the .tendency for target words to become rela- 
tively easier for subjects as grade level increases. *Here too, seventh 
and eighth grade gUbjects' scares were artifically inflated by the ^ 
topping out effect which resulted /from giving these upper grade subjects 
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ihe same test levels as sixth grkde subjects. 
Synonym In Context 

Table 5 lists the mean^ scopes for the synonym In context format 
by test level and grade. A -graph of mean scores IM shown In Figure 
8* The overall rise In meaq scores across grades strongly suggests 
an Increasing ability to use context In demonstrating word knowledge. 
The most noticeable feature of Figure 8, however. Is the exceptionally 
low mean score for second grade subjects.. Explanation for low scores 
at this level may be that the Halted second grade vocabulary prohi- 
bits using sentiences of any great length or complexity. The limited 
vocabulary and the restriction of providing only one sentence of con- 
text were considerable constraints , In creating second grade level test 
Items. As a result, the efficacy ^of using synonym In context as a 
diagnostic test format in the primary grades is questionable Perhaps 
with long passages to provide more contextual clues, the abilities of 
primary grade subjects to use context to demonstrate word knowledge 
could be more fully explored.' ^ 
Cloze 

' Table 6 lists the mean scores b^ level §nd grade for the cloze 
format. Figure 9 presents a graph of mean scores far each grade. As 
does Figure 7, Figure 9 also shows an overall rise in mean scores 
except for a drop at third grade level. Examination of Table 6 . 



shows scores for test levels three and four to be very low. '^tein 
analyses for those test levels suggest that, once agaii>, a^^^imber 



of target words, as well as a few of the distractors, may have been 
too difficult for the grades assigned to them* Item 5 from Level 3 



Table 5 

Mean gcd%es (% Correct) on Synonym . 



in Context Format by Grade and Test Level 



/ 



Grade 



Test 
levql 



i_ y ■ ' 

X 29 

SD ' 20 

N • . 8 ■ 

2_ (. 

X 45 66 • 

SD » 27 28 • ' ' 

N / . S 7 

3_ 

X 30 61 63 

SD 11 30 • 29 

N • 8 7 8 

r 

X ' 44 58 77 

SD ° 30 28 40 




N 7 3 

5_ . r 

X * 43 63 84 83 88 

SD ^ -24 12 • 9 16 13 

N . 8 3 9 10 11 

6 . ■ ' } ■ ~ ■ ■• 

X • 53 80 78 89 

SD ' '. . 40 13 15 14 

N ^' \ ' 3 " .9 10 . 11 

7 • 

X 88 86 85 

SD . . 10 8 \ 11 

N ■ . - ° 9 10 ■ 11 
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Figure 8. Mean scores (% correct) on synonym 
' in context .format, by grade ^ 



/ 
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Test 
level 



Table- 6 
Mean Scores (% jCorrect) on 
Clozg Format by Grade and Test Level 



Grade 



X 9 87 , ■ 

SD • 15 

N 6 . 
2_ 

X 58 76 . . 

SD 19 24 

N 6 8 

3_ 

X 40 35 71 

SD 23 ^ 28 28 

N 6 8 8 

4 

X . 30 73 75 

SD 28 34 10 

N '8 8 6 



X 


55 


62 


85 


89 


91 


SD 




, 22 • 


11 


12 


10 


N 


8 


6 


10 - 


12 




X 




72 


89 


91 


90 


SD 




16 


13 


11 


15 


N 




5 


10 


12 


11 


r 

X ■ % 






80 


93 


91 


SD ^ 






12 


11 


17 


N . 






10 


12 


11 
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of the Cloze Test is an exMople: 



' The blue water^ was 
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glistening (82% at sixth grade) 

depressing (69% at sixth grade) 

expensive (69% at fourth grade) 

V cozy (77% at fourth grade) 

The figures in parentheses indicate the percentage of school children 
at the grade level indicated in a nationwide sample knowing fhese 
words (Dale & 6'Rourke, 19767* In addition, there may be a problem ' 
associated with the cloze format itself, because the context of a 
brief sentence may not rule out :all but the /targeted response. This 
presents a considerable problem when using the cloze format for X 
testing vocabulary in the primary grades. Corollary to this, a final 
explanation for the depressed scores on Levels 3 and 4 is the novelty 
of the cloze format itself. Typically, students receive little prac- 
tice on cloze tasks until the later elementary grades. Finally, a 
ceiling effect was noticeable in the upper grades (seventh and eighth). 
That is, given the relatively easier range of difficulty for the target 
words on test levels 5, 6, anc( 7^ the scores do not reflect the same 
degree of spread as might be seen if the test included levels for 
eighth and ninth grades as well. 

Summary 

As a result of Study 1, several kinds of problems became apparent. 
Some of these problems concerned the use of on-line systems for 
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diagnosis; others Involved the testing Instruments used In the study. 
In particular, the false positive matking of words as known word in 
the Self-screening Test (when the "NEXT" key was hit twice in succes- 
sion) is a pro>lem which can be rectified at the technical level. th< 
hardware must be altered to fit the situation when younger children, 
unfamiliar with interacti^ terminal^ wiH be using keyboards. " 

Other problem areas lie within the teists th%^elves. The feasi- 
bility of drawing vocabulary items ffom existent standardized test* 
was called Into question. Consequently, more careful attention 'must 
be giv^n to other sources of items when these tests are revised. 
Also, the two formats which utilizelf the context of a single sentence 
(cloze. and synonym in context) were discovered to be/^nappropriate 
for the primary grade subjects. Because the ability to use cop^xt , 
to demonstrate word knowledge is an important vocabulary skill to 
assess, alternative formats shojtld be explored. Ope likely alterna- 
tive would be tp^utilize passages, rather than single sentences, in 
order to provide more contextual information within the constraints 
of short sentence length and limited vocabulary usage. . Finally, the 
ceiling effect discernable at the uppef elementary grades (seventh 
and Eighth) can be eliminated by the development of additional tests 
for levels 8 and 9. 



STUDY 2 . , 

i 

Study 2^ exaklned three paradigms for assessing vocabulary know- 

i 
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If ^ ^ ' " - ^ 

ledge: synonym out-of-context , synonym in context, and cloze. The 
goal of the study was ^ determine which of the vocabulary formats 
correlated most highly, with ? standardized measure of reading compre- 
hension. The three vocabulary tests were administered on-line, using 
the PLATO terminal, while the global reading comprehension test was 
a paper-and-pencil test. 

The Synonym out-of-cont^t Test required subjects to choose, from 
among foyr alternalives, the word closest in meaning to ^ target word. 
The Synonym in Context Test presented the target word withiii the 
context of a sentence, and then required th6 subject to choose, from 
among four alternatives, t^he word. closest in meaning 'to the target 
word. The Cloze Tesjt required subjects to select, ,from amcing four 
alternatives, the word which best fit in a seri^fc^ce that had a word 
deleted, ^he global reading comprehension test aoministered to 
subjects was at appropriate grade levels as determirred by ttki^ reading 
subtest of the Metropolitan Achievement Tests. 

Method 

The ^imuli for the three vocabulary tests (Synonym out-of- 
co?ffc%;^^t, Synonym in Context, and Cloze) were the same as in Study 1. 
Based on the results of S tudy 1 , the Self —screening Tes t and Oral 
Re^«gnl/tion Test paradigms i^re omitted from further investigation. 



(Appendix A provides a sample of the 'test items that were adminis- 
tered.) The reading subtest of the Metropolitan Achievement Tests 
was §^ministered from the test (booklet. Grade one received the 
Primary I level, grade three received the Elementary level, and grade 
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five received the Intermediate level. All three grades received 
Form F of the test^*. 

Subjects . 

A total of fifty-six students from grades one, three, and five 
of an elementary school in Inner city Chipago, Illinois participated 
in the study,' The students were from th^ same school as in Study ^ 
1. it was anticipated that all testing would be completed in a 
single school day. Because of difficulty with the main computer ^f£^ ^ 
Champaign, the testing session took one and a half days. Testing 
was conducted on June 2, 1977 and dttfing the morning of June 3rd. 
Prpcedure !) "* ^ 

'Subjects were brought from their classrooBs in groups of 20 
to 24 to Wright Junior Community College. Subjects were 
seated at tables and given directions for the reading subtest of 
the Metropolitan Achievement Tests (as described In the Teacher ' s 
Directions Manual fof the Metropolitan Achife'^Cnent Tests). The 
appropriate level of the Metropolitan Achievement Tests was then 
administered to the subjects. Test administration took between 30 
and 35 minutes, depending on the 1 evel of the test . 

Following administration of the reading subtest, of the Metropolitan 
Achievement Tests, each subject was assigned a "PLATO name." The 
students were then taken to the PLATO terminals and given instruc- 
tions on sljgn-on procedures. Sign-on procedures took between three 
and seven minutes, with younger students taking longer. 

After the sign-on w^s completed, . subjects we^re shown an inter-^ 
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active display to acquaint them with procedures for selecting and 
changing an answer. After the subjects were allowed sufficient 
time to practice these skills (approximately three to five minutes), 
they were given or\e af the three vocabulary test formats. Three 
levels of te^ts were given witlji« a format: one test^ just below 
grade level, one test at grade l^el, and one test" just above grade 
level. The tests were presented in order of level of difficulty 
from easiet to mosf difficult. 

Total time at the PLATO terminal for each group of 20 to 24 

■'^ a . . * 

students was 35 to 40 minutes, 

■V ■ 

Results 
» ' 

The mean scores for grades 1, 3,i and 5 on the vocabulary formats 
are summarized in Table 7, ' The number of subjects tested was less 
^han anticipated, due to difficulties with the PLATO system. 

Table,? i' 

~- Mean Scores (by Grade) on Thtee 

Vocabulary Formats 



r 







Formats 






Synonym 


Synonym-out- 




Grade L^el 


in context 


of-context 


Cloze 




45.05^ 


'36.28 


50.40 




N = 8 


N = 9 


N = 8 ■ 


3 


67.14 


68.0 ■ 


68.57 




N = 7 


N = 5 


N = 7 


5 


( 66.7 


48.66 


74.41 




N = 1 


N = 5 


N = 6 


• 
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Because of the resulting small number of subjects in each cell, 
readers should be cautioned against generalizing from these data'. 

Despite the smaH number of subjects, the data in Table 8 are | 

^ ' • \ 

interesting and infer a relationship between vocabulary knowledge 

and comprehension 'ability . . Examination of the relative size of 
correlations in successive grades in Table 8, reveals that the older 
the subjects, the higher the correlation between vocabulary and ^ 
comprehension scores. This was true even though item analysis in- 
dicated that portions of the tests (especially at grade 3) may have 
utilized target words too difficult for the designated 'gra4e- level. 

' \ Tab^e 8 / 

Pearson Correlations of Vocabulary 

1 

Formats with Metropolitan, by Grade! 

Formats 



Synonym Synonym-out- 

Grade Level in context of-context ^ Cloze 

1 .4247 .7626 .8056 

3 .7420 .9712 .8335 

/ ■. ^ a 

5 ' /9938 .9837 

— : 

a ' 

Cell size too small to compute meaningful correlation. 



, WiCTI^or without the provision of context, there was an overall 
-:!^se in mean scores, in ascending grades* as well as high^r correla- 
tions between the' vocabulary test scores and Metropolitan reading 



test scores as grade level increased. 

Within grades, results were less clear. The' Synonym out-of- 
context and Clbze Tests showed good overall correlation with' com- 
prehension scores equal for all -grades. , The results of the Cloze 
Test are not surprising, as cloze is often used as a measure of * 
comprehension. Results of using the cloze format are particularly 
interesting at the first grad^. level because Children "^typically 

Si ^ 

receive little practice on cloze tasks until the middle elementary 
grades^ Moreover, analyses of mean scores fa^^ first grade subjects 
oh the three vocabulary formats revealed that performance increased 
with the amount of contextual information provided. 

■ k'' 

Although these results should be viewed cautiously, ^the test 

dada nevertheless provide valuable clues as, to how elementary school 

" ■ 

children- utilize contextVto demonstrate vocabulary knowledge. The 

' • / . ■ '■ , ^ \ ' ' ' 

data also indicate that no Single method o f vocabulary assessment 

correlates highly with comprehension ability across all elementary 

grades, thus suggesting that no oneWocabulary- tes% format is 

superior for all grades. The study did delineate some interesting 

issues for further research in the area of format effects upon vocabi: 

lary assessment performance. These issues will be examined more' 

atomdstically in future studies, through the use of groUp-adminis- 

tered paper-and-pencil tests. - a 

■ \/ • . ■ ^ ' * ' 

STUDY 3 " 



Study 3 was an extension of Stydy 2; As in the previous study. 



the main goal of Stiidy 3 was to^ determine whl^^i^f^hr^ee vocabu- 
lary test formats^ synonym out-of-conte^^t, synonym In contS^xt, or' 
cloze, correlat^dmost highly with a standardized measure of 
readlri^g'^coS^^henslon, The three vocabulary tests we^^dmij-nls- 
tered on-line, using the PLATO termini, ^hlle the global reading 
comprehension test was a paper-and-peric^l test. 

• . Method ' - / 

The formats for the vocabulary tests, synonym out-of-context , 
synonym In context,* and cloze, were the same as. those used In 
Studies 1 and 2, Some test Items were revised, however, based on 
an Item analysis donje^as part of Study 2. The stimuli for level 

^ ■ . ■ y - 

4 of the three test fdrmats are ahown In Appendix B. 

As in Study 2j the reading subte^ of the Metropolitan Achieve- 
merit Tests (FtfTH^^) was used^as the global measui^Se ^of reading 
comprehension. The test was administered by school personnel In 
Sei^tember 1977, and the data made available to the Wlscon&lf] 
Research and Development Center for^^ Individualized Schooling 
Subjects * ■ ' • ^ . ■ \A / 



A tot^JLof 128 students from grades 2 through 5 of aft eiemen- 
tary school In Champaign, Illinois participated In the study. The 
schoop/ls located In a lower socioeconomic neighborhood. The school 
uses PLATO as a means of li^tructlon, so the pupils were already 
i^amillar with using the terminal. Testing wajs conducted on^ November 
21 and 22, 1977. ^ ^ , ' ■ 

Procedqrjj 



Subjects were brought "from their classrooms li^' groups of IQ. to 
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the PLATO laboratory in the elementary school. Subjects were 
assigned special "PLATO names" for the study, and were given a 
brief practice session on how to select and change answers. Because 

■> : r ■ 

these students were already "PLATO-sophisticated, " it was. not 
necessary to give extensive directions on sigrj[ing-on and using 
the terminals. 

After a few minutes of"^practice, subjects x^ere given one of 
• ' ' ■ y , 

the three vocabulary test formats. As in the previous study, each 

pupil was given three levels of tests within a single format. The ' 

tests were presented in graduated levels of difficulty starting 

with the one just below grade' level, to the test at grade level, 

afid finishing with the .test just above grade level. Total time 

at the PLATO terminal for each group of subjects w^ approximately 

20 to 25 minutes. ' , 

Results 

Summary statistics for the four grades tested (grades 2 through 
,5). on the vocabulary forvS^ and on the reading subtest of the . 
Metropolitan Achievement Tests are presented 'in Tables 9 and 10. - 
Table 11 lists the number of subjects tested on eachdevdl of the 
three formats. Table 12 summarizes the observed correlational 



relationship of. vocabulary format to comprehension ability by grade 
level. Table 13 presents the results of a two-way analysis^ of , 
variance. Examination of the"" relative size of the correlations ^ 
in successive grades on TaWe 12, reveals that fourth and fifth grade 
subjects showed far higher correlations between vocabulary ^nd 



43 



( 



Table 9 

K 

Summary Statistics^ for Vocabulary 
Formats (% Correct) by Test Level 



Test Level 


N, 


■X 


SD' 


1 


40 


51 


26 


2 


76 




27 


3 


109 


41 ^ \ 


23 


■ 4 


104 


56 


\ ' 


5 


68 


45 


\ 


6 


30 


' 53 ■ 





Table 10 

Summary Statistics for Metropolitan 
Comprehension Subtest (Raw Score) 
by Grade 



Grade Level 




Md _ 


X, 


SD - 


2. 




32 


29.22 


10.47 


3 


33 


31 


29.38 


9.09 


4 


32 ' ' 


19 


-19.83 


9.13 


5 




23 


21.38 


8.21 
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. Table 11 

i 

Number of Subjects Tested 



on Vocabulary Formats by 

1 ^ ■ ' 

/ Level and by Grade 



Grade 



Test Level 


2 


3 


4 


5 


Tota] 


1 


36 , 


0 


0 


0 


36 


2 


36 


33 " 


0 


0 


69 


3 


36 


33 


32 




101 


■ 4 


• 0 


33 


32 


27 


92 


5 


0 


. 0 


32 


27 


59 


<. 6 


0 


0 


0 


27 


27 



Table 12 

Pearson Correlations of Vocabulary 
Formats with Metropolitan, by Grade 

' 

, ^ ■ Formats 

Synonym out- Synonsm ±n^ 



Grade Level of-context Context Cloze 

2 .408 ^422 .435 

,3 .498 ' .351 .410 

4 ^ .7-^7 .889 .717 

^ 5 .82/, - .830 .863 



3? 

/ 

comprehension scores than did second and third grade subjects. 
The reasons for this observed split between grades 2-3 and 4-5 
are unclear. It is possible that the target words for fourth 
and fifth grade test levels Were relatively easier for older 
subjects than the target words for second and third grade test 
levels were for younger subjects. An item analysis of the -tests, 
however, did not support this » conjecture. 

A major goal of this study was to determine which vocabulary 
format correlated most highly with comprehension Within, as well 
as across, grade levels. Again, no obvious pattern was apparent. 
Unlike the observations in Study 2', primary (second and third) 
grade subjects' comprehension scores did not show high correlations 
with any of the vocabulary formats, and the differences in per- 
formance between the three formats did not appear significant. At 
the fourth grade level, the Synonjrm in Context Test was most 
highly correlated with comprehension, but at the fifth grade level, 
the Cloze Test had the highest correlation with comprehension. Re- 
sults of an analysis of variance showed no significant format 
effect and no significant interaction effect of format and grade 
(see Table 13). There was, however, a significant grade level 

effect (p < .001) . 

/ Discussion 

Study 3 identified two major issues that warrant further in- 
vestigation: 

1. The vocabulary tests may be of uneven difficulty for 
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Table 13 
Two-way ANOVA of 

Main Effects: Format and Grade 



Source 



df 



Main Effects: 

Format 2 
Grade 3 



MS 



338.46 
2540.7$ 



0.77 
5.77 



0.466 
0.001 



f 



Interaction: 

-Format x 
Grade 

Error 



6 

116. 



211.92 
44.0.70 



0.48 



0.821 



ERIC 
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successive grade levels. This notion will be examined in further 

administrations of a paper-and-pencil version of the test, with 

item analyses to assess test validity at all gr|ade levels. 

2. Fourth and fifth grade subjects utilize vocabulary and 

comprehension skills in a unified fashion.v^ Assessment methods for 

'^ vocabulary knowledge frequently measure some strategies common 

to both vocabulary and comprehension abilities. At the primary 

- grades (grades 2 and 3), subjects' strategies for vocabulary^growth 

and comprehension appear to be less integrated. 

• ■ . ' ■ / 

Although the data collected in Study 3 did not resolve the 

questions of which vocabulary format most effectively assesses word 

knowledge, and^which-format shows the most consistent performance 

pattern across grade levels; Stlidy 3 did suggest an interesting issue 

for further investigation: Gould the underlying relationship between 

vocabulary knowledge and comprehension ability be discontinuous across 

grade levels? ^ X 

Because Study, 3 djpmonstrated ciiat no one^of the three vocabuXary 
assessment formats was significantly inferior to the other two, all 
three formats will be included in future studies. The issue of a 
possible discontinuity in the relationship of vocabulary knowledge, 
to comprehension ability across grade levels will also be explored. 

Summary ^ 

The results of Study 3 indicated lower correlations between 

vocabulary knowledge ^(on all three assessment formats) and compre^ 

t 

hension ability for grades 2 and 3 than for grades 4 and. 5. No 



single format proved to be superior in assessing vocabulary know- 
ledge across all grade levels. A hierarchy of difficulty for the 
three vocabulary formats was not apparent. Further testing wiW 
explor^^ the observed discrepancy of vocabulary and comprehension 
correlations between the performances of prim; ^y (second and 
third) and middle (fourth and fifth) grade subjects. Finally, in 
future testing sessions, item analyses will ba performed on target 
words to ensure that tests are appropriately graduated in difficulty 
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Appendix A 
Stni; for Study 1 drid Study 2 

Self-screening Test, Level. 4 
Oral Recognition Test, Level 4 
Synonymr-out-of- context Test, Level 
Synonym in Context Test, Level 4 
Cloze Test, Level 4 
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Self-screening Test 



Level 4 

briskly 

feeble 

hesitate - 

gigantic 

concealed 

pauper 

confident 

menacing 

obvious 

pursued 
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Oral Recognition Test 



Lx?vcl 4 



Stimulus 

briskly- 

feeble 

hesitate 

gigantic 

concealed 

pauper 

confident 

menacing 

obvious 

pursued 



Responses 



briefly 

freedom 

state 

gyration 

concubine 

powder 

convince 

mendacity 

obtain , 

purse 



blackie . 

table 

hasty 

gymnastic 

concrete 

paper 

confetti 

mention 

eQ^stain 

persist 



biscuit 
triple 
estate 
gentle 
convinced 
paucity I 
condemn 
marking 
cd3ound 
purpose 



SynonyiTHOut"Of"Context Test 



-Level 4 



Stimulus 

\ 

^riskly 
feeble ^ 
hesitate 
gigantic 
concealed 
pauper 
confident 
menacing 
obvious 
pursued 



Responses 




slowly 


sadly 


' rapidly 


wecdc 


funny 


fleet 


pity 


provide 


. 1 

pounce 


huge 


minute . 


size 


fcUDOUS 


displayed 


hidden 


helpless 
'Careful 


unhappy 
sure 


poor 
fearful 


inspiring 


- regular 


slinking 


evi^dent' 


* crazy ^ 


unsure " 


p^ished 


chased 

53 


helped 



awkwardly 
strong 
pause 
narrow 
peaceful 

lOBtw 

hesitate i 
dangerous 
forgive 
caught 



Synonym in Context Test 



Level 4 



S timulus 

(The target word is 
underlined. ) 

The horse ^trotted bri/skly along 
a familiar path. 



/ 



The feeble old dog walke 
woman . 



besi 



de the 



Responses 



slowly 
rapicjiy 



weak 
fleet 



sadly 
awkwardly 

funny 
strong 



She did not hesitate in defending 
herself against the attack. 



pity 
pounce 



provide 
pause 



The gigantic giraffe licked the child's 
hand. 



huge 



size 



miniSte 
narrow 



He concealed the gun in his coat pocket-. 



famous 
hid 



displayed 
peaceful 



The pauper hand no money for food. 



helpless 
poor man 



unhappy 
lost 



The candidate was confident that 
she would win. 



care ful 
fearful 



sure 

hesitant 



The robber gave the woman a menacing 
look after she screamed. 



John's mistake or} his math test was 
an obvious error in subtraction. 



inspiring 
slinking 

. evident 
pleasant 



regular 
evil 

crazy 
forgive 



The cat ^pursued the mouse across the 
kitchen floor. * : . 



punished 
helped 



'chased 
caught 
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Cloze Test - / 



Stimulus 



Response 



The horse trotted 
3t familiar path. 



along 



The* 



old dog walked basMe 



the woman. 



ShQ did not' 

, against the attack. 



in' defending herself 




th^ ^ '<<^ '.-^raffe licked the child's ' > * 
hand. <^ - 



. the gun irt his coat pocket • 



The 



had no Inoney for food. 



The candidate was 
win . 



that *she would 



The robber gave the woman a 
after she screamed/ 



look 



John's mistake on his: math. test was an ' 
" error in subtraction. 



Tfie cat^ 

kitchen fl^r. 



the mouse aLcros^s the 



3 f 



briskly 
below 

y feeble 
fleet 

hesitate 
encam^^- ^ 

■\' gigantic 
size 

concealed 
peaceful \, 

'pauper 
lost 

confident 
hesitcint 

menfei^cing 
slinking 

r ■ ' ' ' 
obvious 

, i^hing , 




after 
twelve 



young 
friend 



provide 

minuted 

prayed 
^ famous 

^^happy 
''helpless 

after 
heavy 

regular . 
ispiring 

ingry 
empty 

smiled 
slept 



Appendix B 
^Stimuli for Study 3 



> 



Synonym-out-of-context Test, Level 4 



Synonym in Context Test, Level 4 
Cloze Test, Level 4/ 



ERIC 



56 
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Synonym-out-of-context Test 



Leved 4 




Stimulus 
gigantic 






Responses 




huge j 


baby 


friendly 


gain 




need / 


have 


put oh 


nervous 




hungry 


uneasy 


young 


broken 




destroyed 


shaken 


dirtied 


concealed^ 




wanted 


discovered 


found 


feeble 




funny. 


unhappy 


weak 


briskly 




slowly 


quickly 


sadly 


exhibits 




acts 


people. --__y 


- rides 


surprised 




amazed 


sick 


gone 


twisted ^ 




held 


wound 


found 



s 



lonely 
lose 
tired 
in6v^d 
hid 
strong 
awkward 
displays 
bored 
placed 
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Synonym in Context Test 



Xevel 4 



S^timUlus 

(The target word is 
tfunderlmed, / 

The gigantic giraffe licked the 
child's hand. 



sponses 



^huge - 
friendly 



baby 
lonely 



Ann will gain weight 'from eating 
too much cake. 



need 
put on 



have 
lose* 



Patty bit her nails, because she 
was nervous. 



, hungry 
young 



xmeasy 
tired 



Many of our, dishes were l^oken by the 
earthquake. ^ 



destroyed 
dirtied 



shaken 
^ moved 



He concealed the gun in his coat pocket. 



wantetd 
found 



discovered 
hid 



^-The feeble old dog walked beside trie 
woman. ^ 



fi^iny 
weak 



unhappy 
strong 



The horse trotted briskly along a 
familiar path. 



slowly 
sadly 



qiiifckly 
awkward 



There were many interesting exhibits at 
the science fair. 



acts 
rides 



people' 
displays 



Mark was surprised When his friend from 
Texas arriyed. 



^amazed"^ 
gone 



sick 
bored 



Cathy twisted a rubber 3j>and around her 
finger. 



founc 



wound 
placed 
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Cloze Test 
Level 4 



Stimulus 



Responses 



that he 



The giraffe was 
made even the elephants- look small. 



gigantic 
friendly 



young 
lonely 



Ann will 
too much . 



weight from eating 



need 
gain^ 



have* 
lose 



Patty bit her nails because she was 



Many of our dishes were 



by 



the earthquake'' and we had to sweep ^' 
up all the pieces. " 

^/ 

He the gun in his coat" pocket 

so no one would know he had it; . 



smart 
young 

broken 
lost 

made 
found 



nervous , 
asleep 

i 

shaken / 
moved 

discovered 
. concealed 



The old dog could barely keep 

up with the woman, but wagged his tail 
happily anyway. v 

The hors4 trotted alon^the path 

and arrive^ home sooner than usual. 



There were many interesting at 

the fair which showed how different 
foods got from the farm to our tables. 



Mark was 



and happy when his friend 



arrived Unexpectedly from Texas. 



Cat] 



around so she could reach 



the book on the shelf behind" her. 



quick 
feeble 

slowly 
sadly . 

acts 
rides 

sick 
bored 

held 
found 



unhappy 
strong 

briskly 
awkwardly 

people 
exhibits 

gone 

surprised 

twisted 
placed 
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